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(57) ABSTRACT 

A system for controlling presentation of information to a 
user based on the user's current condition. In particular, the 
system monitors the user and the user's environment, and 
creates and maintains an updated model of the current 
condition of the user. The user condition can include a 
variety of condition variables, including abstract concepts 
such as the user's current cognitive load, desired level of 
privacy for output information, and desired scope of audi- 
ence for output information. Upon receiving output infor- 
mation to be presented to the user (e.g., from an application" 
program), the system determines an appropriate output 
device and an appropriate format with which to present the 
information to the user, and then presents the output infor- 
mation. The system can also receive description information 
about the output information that describes relevant factors 
for determining when and how to present the output infor- 
mation (e.g., the importance and urgency of the output 
information, the consequences of the user not receiving or 
ignoring the output information, etc.). Some versions of the 
system execute on a wearable computer having a variety of 
available output display devices. 
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Fig. 3 



Model of User Condition 210 



User: X Time: 14:22 Date 10/15/XX 
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Ambient Temperature 
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Physical: None. Audio: "Doug Smith" 
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Talking on Cell Phone, Walking 
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Application X-Factor 1 


Normal: Mean-23, Std Dev 3 










User Format Preference 


Visual > Auditory 




User Device Preference 
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Fig. 9 
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METHOD AND SYSTEM FOR 
CONTROLLING PRESENTATION OF 
INFORMATION TO A USER BASED ON THE 
USER'S CONDITION 

TECHNICAL FIELD 

The present invention relates generally to computer pro- 
gram user interfaces, and more particularly to presenting 
information to a user based on the user's current condition. 

BACKGROUND OF THE INVENTION 

As computers become increasingly powerful and 
ubiquitous, users increasingly use their computers for a 
broad variety of tasks. For example, in addition to traditional 
activities such as running word processing and database 
applications, users increasingly use computers as an integral 
part of their daily lives. Programs to schedule activities, 
generate reminders, and provide rapid communication capa- 
bilities are becoming increasingly popular. Moreover, com- 
puters are increasingly present during virtually all of a 
person's daily activities. For example, hand-held computer 
organizers (e.g., PDAs) are increasingly common, and com- 
munication devices such as portable phones are increasingly 
incorporating computer capabilities. Thus, users may be 
presented with output information from one or more com- 
puters at any time. 

While advances in hardware make computers increas- 
ingly ubiquitous, traditional computer programs are not 
typically designed to efficiently present information to users 
in a wide variety of environments. For example, most 
computer programs are designed with a prototypical user 
being seated at a stationary computer with a large display 
device, and with the user devoting full attention to the 
display. In that environment, the computer can safely present 
information to the user at any time, with minimal risk that 
the user will fail to perceive the information or that the 
information will disturb the user in a dangerous manner 
(e.g., by startling the user while they are using power 
machinery or by blocking their vision while they are moving 
with information sent to a head-mounted display). However, 
in many other environments these assumptions about the 
prototypical user are not true, and users thus may not 
perceive output information (e.g., failing to notice an icon or 
message on a hand -held display device when it is holstered, 
or failing to hear audio information when in a noisy envi- 
ronment or when intensely concentrating). Similarly, some 
user activities may have a low degree of interruptibility (i.e., 
ability to safely interrupt the user) such that the user would 
prefer that the presentation of low-importance or of all 
information be deferred, or that information be presented in 
a non-intrusive manner. 

In addition to assuming that a user is devoting full 
attention to the display, current computer programs typically 
assume that only the user is devoting attention to the 
computer system. Thus, current computer programs are not 
concerned with factors related to the user's environment, 
such as whether other people around the user are disturbed 
by information being presented or whether sensitive infor- 
mation is inadvertently made available to others. Instead, 
current computer programs typically assume that the user 
will request output information only at appropriate times and 
that the user will control whether others are privy to output 
information (e.g., by orienting the display accordingly or 
adjusting speaker volumes). 

However, as computers are increasingly present with 
users and are designed to present output information other 
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than at a user's immediate request (e.g., reminding the user 
of an upcoming appointment), computer programs are 
increasingly likely to present information in a manner that 
interrupts the user (and may be bothersome or dangerous), 
5 that may not be perceived by the user even if highly 
important and urgent, that may disturb others around the 
user, and that may inadvertently reveal sensitive information 
to others. 

A growing trend of using wearable computers will only 
10 exacerbate this problem. Such wearable computers are 
designed to act as constant companions and intelligent 
assistants to a user, thus being available to receive input 
from the user at any time and to present output information 
to the user at any time. Wearable computers are typically 
15 strapped to the user's body or mounted in a holster, and may 
include a variety of both input and output devices. The close 
association of wearable computers to their users results in 
the wearable computer interacting with the user in virtually 
any social or business situation, and thus the likelihood of 
20 inappropriate output behavior increases. 

SUMMARY OF THE INVENTION 

Some embodiments of the present invention provide a 

25 method and system for controlling presentation of informa- 
tion to a user based on the user's current condition. In 
particular, the system monitors the user and the user's 
environment, and creates and maintains an updated model of 
the current condition of the user. The user condition can 

30 include a variety of condition variables, including abstract 
concepts such as the user's current cognitive load, desired 
level of privacy for output information, and desired scope of 
audience for output information. The user condition can also 
include condition variables indicating physical characteris- 

35 tics (e.g., deafness) and physically observable characteristics 
(e.g., movement or proximity to another object) of the user. 
Upon receiving output information to be presented to the 
user (e.g., from an application program), the system deter- 
mines an appropriate output device and an appropriate 

40 format with which to present the information to the user, and 
then presents the output information. In some embodiments, 
the system also receives description information about the 
output information that describes relevant factors for deter- 
mining when and how to present the output information 

45 ( e *g-> tne importance and urgency of the output information, 
the consequences of the user not receiving or ignoring the 
output information, etc.). The system executes in some 
embodiments on a wearable computer having a variety of 
available output display devices. 

50 In one embodiment, the system presents output informa- 
tion to a user by first receiving information about a modeled 
characteristic of the user which may include a modeled 
preference of the user for receiving sensitive information, a 
modeled indication of a current degree of interruptibility of 

55 the user, or a modeled preference of the user for an amount 
of people to perceive information presented by the com- 
puter. The system then selects an output device capable of 
presenting the output information in accordance with the 
modeled characteristic, and presents the output information 

60 on the selected output device in accordance with the mod- 
eled characteristic. 

In an alternate embodiment, the system presents informa- 
tion to a user on one of multiple available output devices. 
The system monitors the user to collect information about a 

65 current state of the user, and then models a current user 
condition based on the collected information by determining 
a current level of privacy desired by the user that indicates 
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a group of people allowed to perceive information presented and geographic information (e.g., location and speed), while 

by the computer, by determining a current scope of audience higher levels of abstraction may attempt to characterize or 

desired by the user that indicates how many people are predict the user's physical activity (e.g., jogging or talking 

intended to perceive information presented by the computer, on a phone), emotional state (e.g., angry or puzzled), desired 

and by determining a current cognitive load of the user that 5 output behavior for different types of information (e.g., to 

indicates ability of the user to devote attention to the present private family information so that it is perceivable 

computer. The system then receives output information to be onl y t0 myself and my family members), and cognitive load 

presented to the user, and presents the output information in » the amoum of attenl ion required for the user's current 

a manner consistent with the modeled current user condition activities). Background information which changes rarely or 

by selecting one of the output devices such that information 10 D °i at . a11 » n al f 0 £ inclu ^> such » ^ f e < s g cnder 

' ceknt ^ t ° ™„u;i; t ;oc ~r ,h 0 ro i 0 , to j rt „t„„t a^a~ and visua l acuity. The model can similarly hold environment 

presentation capabUn.es of he selected output device sup- MormMioa „ { low level of abslractio ^ such „ air tem . 

port the determined current desired level of privacy, the ^ of faw da , a ^ a motioQ • , eve , s 

determined current desired scope of audience, and the deter- of abstraction> such „ ^ number and identities of nearby 

mined current cognitive load, and by presenting the output people> objects> ^ locations . ^ model of tbe ^ 

information to the user on the selected output device, so that 15 condition can additionally include information added explic- 

the presentation of information by the system satisfies the itly fj 0m otner sources (e.g., application programs), as well 

modeled current user condition. a s user-specified or system-learned defaults and preference 

ddicc nccrDiDnnM r>c -rue nn A«/i».r/-c information. An illustrative example of a model of a user 

BRIEF DESCRIPTION OF THE DRAWINGS condition is described in greater detail with respect to FIG. 

FIG. 1 illustrates a user wearing a body-mounted com- 20 ^. 

puter executing an embodiment of the Condition-Dependent Th e CDOS system includes a User Characterization 

Output Supplier (CDOS) system of the present invention. Module, an Output Device Selector Module, and a Format 

FIG. 2 is a block diagram illustrating the contents and Module associated with each available output device^ The 

information flow of an embodiment of the CDOS system. ^^^^1^ T 'V^h w ^ 

J 25 user s environment in order to create a current model of the 

FIG. 3 is an illustrative example of a model of a current user ' s condition. After the User Characterization Module 

user condition. has created a model of the user's current condition, the 

FIG. 4 is an illustrative example of a User Characteriza- Output Device Selector Module and the one or more Format 

tion Module. Modules can then use the model to determine when and how 

FIG. 5 is an illustrative example of an Output Device 30 to P resent out P ut information to the user. 

Selector Module. The User Characterization Module can receive a variety 

FIG. 6 is an exemplary flow diagram of an embodiment ° f tv P es of formation, and can use this information to 

of the User Characterization routine. determine the user s current condition in a variety of ways. 

. e , For example, the User Characterization Module can receive 

RG. 7-is an exemplary flow diagram of- an embodiment user i Dput supplied by the user to the computer system, 

of the Characterize User subroutine. information about the user sensed from a variety of sensor 

FIG. 8 is an exemplary flow diagram of an embodiment devices, information about the environment surrounding the 

of the Output Device Selector routine. user receive d from a variety of sensor devices, indications 

FIG. 9 is an exemplary flow diagram of an embodiment from the CDOS system about output information currently 

of the Format And Present Output Information subroutine. 40 being presented to the user, stored background information 

ncTAii cn nccf-DiDTrnw nc toc about the uscr or about tDe world > aod various types of 

DETAILED ^CWPTON OF THE information from external entities such as application pro- 

grams. 

An embodiment of the present invention provides a User input information alone can provide significant 

method and system for controlling presentation of informa- 45 information to the CDOS system about the user's current 

tion to a user based on the user's current condition. In condition. For example, if the user is currently supplying 

particular, the Condition-Dependent Output Supplier input to the computer via a full-sized keyboard, it is likely 

(CDOS) system monitors the user and the user's that the user is engaged in little other physical activity (e.g., 

environment, and creates and maintains an updated model of walking), that the user is devoting a significant amount of 

the current condition of the user. Upon receiving output 50 attention to the computer system, and that the user would see 

information to be presented to the user (e.g., from an information flashed on the display. If the user is instead 

application program), the CDOS system determines an generating user input audibly (e.g., through a head-mounted 

appropriate output device and an appropriate format with microphone), that fact may provide less user condition 

which to present the information to the user, and then information to the CDOS system since the user can supply 

presents the output information. In some embodiments, the 55 such audio information while engaged in a variety of types 

CDOS system also receives description information about of physical activity. Those skilled in the art will appreciate 

the output information that describes relevant factors for that there are a wide variety of input devices with which a 

determining when and how to present the output information user can supply information to the computer system, includ- 

(e.g., the importance and urgency of the output information, ing voice recognition devices, traditional qwerty keyboards, 

the consequences of the user not receiving or ignoring the 60 chording keyboards, half qwerty keyboards, dual forearm 

output information, etc.). keyboards, chest mounted keyboards, handwriting recogni- 

In one embodiment, the model of the user's current tion and digital ink devices, a mouse, a track pad, a digital 

condition includes a variety of condition variables that stylus, a finger or glove device to capture user movement, 

represent information about the user and the user's environ- pupil tracking devices, a gyropoint, a trackball, a voice grid 

ment at varying levels of abstraction. For example, infor- 65 device, digital cameras (still and motion), etc. 

mation about the user at a low level of abstraction can In addition to the information received via user input, the 

include raw physiological data (e.g., heart rate and EKG) User Characterization Module also uses sensed information 
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about the user. For example, a variety of sensors can provide cognitive load and do not want to be disturbed," "I am 
information about the current physiological state of the user, dealing with private family information that should not be 
geographical and spatial information (e.g., location and made available to anyone outside my immediate family," or 
altitude), and current user activities. Some devices, such as "I am in an environment where I do not wish to disturb 
a microphone, can provide multiple types of information. 5 others around me"). The CDOS system can also receive 
For example, if a microphone is available, the microphone current date and time information in order to both track 
can provide sensed information related to the user (e.g., changes over time and to utilize information such as the 
detecting that the user is talking, snoring, or typing) when user's stored schedule. Previously-created models of the 
not actively being used for user input. Other user-worn body user's condition can also be retrieved and used as a default 
sensors can provide a variety of types of information, 10 or to detect changing conditions. The Output Device Selec- 
including that from thermometers, sphygmometers, heart tor Module can also supply information indicating the types 
rate sensors, shiver response sensors, skin galvanometry of output currently being presented to the user, thus provid- 
sensors, eyelid blink sensors, pupil dilation detection ing information about the user's current activities and cog- 
sensors, EEG and EKG sensors, sensors to detect brow nitive load. Finally, other entities (e.g., application 
furrowing, blood sugar monitors, etc. In addition, sensors 15 programs) can directly provide user condition information 
elsewhere in the near environment can provide information (e.g., new condition variables, whether application-specific 
about the user, such as motion detector sensors (e.g., or not, or new values for existing condition variables), 
whether the user is present and is moving), badge readers, In some embodiments, CDOS systems communicate 
still and video cameras (including low light, infra-red, and between themselves, such as via a wireless medium or when 
x-ray), remote microphones, etc. These sensors can be both 2 q cabled together. This intercommunication can occur 
passive (i.e., detecting information generated external to the automatically, or at the instruction of one or more of the 
sensor, such as a heart beat) or active (i.e., generating a users of the communicating CDOS systems. When multiple 
signal to obtain information, such as sonar or x-rays). CDOS systems communicate, a variety of types of infor- 

Stored background information about the user can also be mation can be passed between the CDOS systems. For 

supplied to the User Characterization Module. Such infor- 2 5 example, a first CDOS system receiving information from 

mation typically includes information about the user that other CDOS systems can use those systems as a type of 

changes at most infrequently, although it is possible to remote sensor in which information received by the User 

frequently update the stored background information to Characterization Modules of the other CDOS systems is also 

reflect changing conditions. For example, background infor- supplied as input to the User Characterization Module of the 

mation about the user can include demographic information 30 first CDOS system. Other CDOS systems may have access 

(e.g., race, gender, age, religion, birthday, etc.) if it can affect to information about the surrounding environment (e.g., a 

how information is presented to the user. User preferences, digital camera) that the first CDOS system does not have, 

either explicitly supplied or learned by the system, can also Alternately, information about the users of the CDOS sys- 

be stored as background information. Information about the tems can be exchanged to facilitate further communication 

user's physical of mental condition which affects the type of 35 between- the CDOS systems or between the users (e.g.,- 

information which the user can perceive, such as blindness, notifying one user that another user has a high cognitive load 

deafness, paralysis, or mental incapacitation, is also impor- and does not wish to be disturbed). Multiple CDOS systems 

tant background information that allows the CDOS system can also act as cooperative systems in which one or more 

to adapt to the user's capabilities. users' CDOS systems are shared with other users (e.g., 

In addition to information related directly to the user, the 40 making available excess computing power or the use of an 

User Characterization Module also receives and uses infor- output device). 

mation related to the environment surrounding the user. For After the User Characterization Module receives infor- 
example, devices such as microphones or motion sensors mation about the user and the surrounding environment from 
may be able to detect whether there are other people near the one or more information sources, the User Characterization 
user and whether the user is interacting with those people. 45 Module will use this information to create a current model 
Sensors can also detect environmental conditions which may of the user's condition. In one embodiment, the User Char- 
affect the user, such as air thermometers or geigercounters. acterization Module merely stores the data it receives (even 
Sensors, either body-mounted or remote, can also provide when it is at a low-level of abstraction) and then allows the 
information related to a wide variety of user and environ- Output Device Selector Module or application programs to 
ment factors including location, orientation, speed, 50 directly use that stored information when making decisions 
direction, distance, and proximity to other locations (e.g., related to presenting output information. In an alternate 
GPS and differential GPS devices, orientation tracking embodiment, the User Characterization Module uses 
devices, gyroscopes, altimeters, accelerometers, received low-level data to generate higher-level rep resenta- 
anemometers, pedometers, compasses, laser or optical range tions of the user's observable activities (e.g., walking, 
finders, depth gauges, sonar, etc.). Identity and informational 55 watching a movie in a movie theater, talking to coworkers at 
sensors (e.g., bar code readers, biometric scanners, laser the office, etc.). 

scanners, OCR, badge readers, etc.) and remote sensors In yet another embodiment, the User Characterization 
(e.g., home or car alarm systems, remote camera, national Module further characterizes the user's condition with 
weather service web page, a baby monitor, traffic sensors, respect to condition variables that are not directly observ- 
er.) can also provide relevant environment information. 60 able. Such condition variables include the current cognitive 
In addition to receiving information directly from low- load of the user (indicating amount of attention required for 
level sensors, the User Characterization Module can also the user's current activities and thus the ability of the user to 
receive information from devices which aggregate low-level devote attention to the computer), the current degree of 
information into higher-level data constructs (e.g., face interruptibility for the user (indicating ability to safely 
recognizers, gesture recognition systems, affective/emotion 65 interrupt the user), the current degree of intrusiveness of 
recognizers, etc.). The user can also explicitly supply infor- output on the environment (indicating impact of output oo 
mation about their current condition (e.g., "I have a high the surrounding environment), the user's desired scope of 
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audience for information being output (indicating bow many 
people should be able to perceive the information), the 
user's desired level of privacy for information being output 
(indicating the group of people who are allowed to perceive 
the information), and the user's desired level of solitude 5 
(indicating the user's current desire to avoid intrusions). 

User condition variables can also represent abstract prin- 
ciples about the user and the surrounding environment, such 
as the user's relationship to other objects, people, or loca- 
tions (e.g., being at their desk, being in their office, being 10 
near the drug store, talking to a particular person, etc.). In 
some embodiments, CD OS systems can supply information 
about user condition variables and their values to other 
CDOS systems, and those other CDOS systems can add the 
user condition variables and/or values to their model of their 15 
user condition if appropriate (e.g., ambient air temperature, 
or an emotional state of a CDOS system's user that is sensed 
by another CDOS system). 

The values for the user condition variables can directly 
impact how and when output information should be pre- 2 o 
sented. For example, when the cognitive load is high or the 
degree of interruptibility is low, output information may be 
presented on a tactile display using light pressure so that the 
presentation is minimally intrusive on the user. Alternately, 
the presentation of the information may be deferred if no 2 s 
appropriate output device is available or if interrupting the 
user is not warranted by low-importance or low-urgency 
information. When the output information is sensitive and 
others present are not included in the current desired level of 
privacy, the information may be presented on an eyeglass- 30 
mounted display, or the information may be presented via an 
earpiece speaker when the scope of audience or intrusive- 
ness on the surrounding environment dictates that others not 
- perceive the presented information. Finally, if the user's 
desired level of solitude indicates that the user does not want 35 
to receive output information (e.g., while asleep, in the 
bathroom, involved in an intimate activity, etc.), presenta- 
tion of all output information or of all but highly urgent and 
important output information may be deferred. 

Those skilled in the art will appreciate that the User 40 
Characterization Module may receive contradictory infor- 
mation related to one or more aspects of the user condition. 
For example, a motion sensor device may indicate that no 
one else is present in a room, while a speech recognizer may 
report that another person is present. Mediation of such 45 
contradictory data can be handled in a variety of ways. For 
example, it may be possible to reconcile such data (e.g., the 
user is communicating with another person via a telephone 
with a loudspeaker). Alternately, the data could reflect 
different readings for changing conditions (e.g., ambient air 50 
temperature may have changed quickly after a window was 
opened). Alternately, when data truly conflicts, it may be 
impossible to reach a conclusion about a user condition 
variable, or the value of the variable may be represented as 
having varying degrees of uncertainty or belief. Both par- 55 
ticular information sources (e.g., sensors) and particular 
pieces of input information can be categorized as to their 
quality and reliability to assist with mediation or to better 
model the user condition. In addition, input information can 
be time-stamped and otherwise identified to assist the User 60 
Characterization Module. 

Those skilled in the art will also appreciate that a variety 
of factors can influence the determination of values for each 
of the condition variables, and that the values for the 
variables can be stored in a variety of ways (e.g., a number 65 
on a scale of 1-100 or 0-255, a probability distribution, a 
value from a delimited set of possibilities, a fuzzy logic 
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value, etc.). Factors which can affect the cognitive load of a 
user include if the user is talking (and the volume of the 
speech), is talking on the phone, physical movement such as 
walking or driving, being stationary, being seated and 
stationary, ambient light and sound, stress and hunger levels, 
a level of rest (e.g., a low level due to a recent lack of sleep), 
activity such as reading e-mail or riding a bull, historical 
data (e.g., user has low threshold for cognitive load while 
watching baseball games), a physical or mental disability, 
location (e.g., at home or therapist's office), presence and 
frequency of user input such as keyboard or mouse activity, 
presentation of output information to the user, emotional 
state, explicit indications from user, etc. Similarly, factors 
that can affect desired level of privacy and desired scope of 
audience include the identity of others near the user, the 
proximity of others to the user, explicit tagging of activities 
or information (e.g., email in my personal account is private 
for only me, while email in my family account is private for 
family members), nature of work being performed (e.g., 
balancing a checkbook, playing a computer game, or revis- 
ing a business spreadsheet), location, historical data, explicit 
indications from user, etc. 

Those skilled in the art will appreciate that when infor- 
mation is being processed and shared between multiple 
systems, it is necessary for a context to be shared so that a 
semantic understanding of what is represented by informa- 
tion can be conveyed. For example, merely reporting data 
for air temperature as being 50 is insufficient. Not only is it 
unclear what scale is being used (e.g., Fahrenheit or 
Celsius), it is also unclear exactly what information is being 
represented (e.g., the air surrounding the user inside a heated 
room, or the outside air). Thus, the components of the CDOS 
system have a shared context as to the meaning of input 
information and user condition variables, including having 
consistency among the components generating values of the 
user condition variables (e.g., rules in the User Character- 
ization Module) and those using the generated values (e.g., 
the Output Device Selector Module and Format Modules). 
In addition, when information from the CDOS system (e.g., 
user condition variables and their values) is shared with 
other entities (e.g., other CDOS systems or application 
programs with output information to be presented), sharing 
of the context with these other entities enables the informa- 
tion to be useful. In some embodiments, other systems are 
designed to share the same context (e.g., via a published 
API), while in other embodiments additional information 
describing the shared information can be supplied along 
with the shared information to establish a shared context. 

In addition to there being a wide variety of factors which 
can affect various condition variables, the User Character- 
ization Module can generate the model of the current user 
condition in a variety of ways. In one embodiment, the User 
Characterization Module includes a variety of rules such that 
when a test portion of the rule is currently true, then the 
result portion of the rule is activated or performed (e.g., to 
cause the value of a condition variable to be modified or to 
satisfy the test portion of other rules). For example, a rule 
could indicate that if the user is talking or the surrounding 
environment is loud, then non-auditory output is preferable 
to auditory output. When this first rule was satisfied, the 
result could trigger the satisfaction of a second rule, such as 
a rule stating that while non-auditory output is currently 
preferable then an eyeglass-mounted display device will be 
used for output. Alternately, a second rule could state that 
although non-auditory output is currently preferable, an 
earpiece speaker device will be used for highly sensitive 
information. Another example of a rule is that if the user is 
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driving an automobile at high speed in bad weather user condition and make their own determination as to when, 

conditions, it is likely that the user has a high cognitive load where and how to present output information (i.e., bypassing 

and would be unable to safely devote much attention to the the Output Device Selector Module and/or the Format 

computer system. Modules). Thus, if the modeled user condition indicates that 

Those skilled in the art will appreciate that there are a 5 particular output information should not currently be pre- 

variety of techniques for combining different types of input sented to a user, the external entity can postpone or cancel 

information and processing it to generating output the presentation of the output information without ever 

information, including look-up tables, neural networks, supplying the output information to the CDOS system. It 

expert systems, genetic algorithms, probabilistic belief may also be possible to configure the CDOS system to 

networks, etc. In addition, values for some user condition 10 automatically notify the external entities of the values of one 

variables may be calculated only periodically or only upon or more user condition variables, such as by pushing that 

specific request for the value (e.g., computationally inten- information to the external entities when changes occur in 

sive variable values such as those generated by a face the values or by periodically notifying the external entities 

recognizer), even if the appropriate input information is of the current values. 

supplied more frequently. Conversely, some embodiments 15 If the selected output device supports different ways to 

of the CDOS system may allow the User Characterization audibly present information (e.g., different audio levels or a 

Module to request or retrieve the appropriate input infor- choice of speakers) or the ability to output information to 

mation needed to calculate one or more user condition multiple senses, the Format Module for the output device 

variables, thus performing demanddriven processing. An will then format the output information appropriately based 

illustrative example of a User Characterization Module is 20 on the model of the user condition (e.g., lowering the 

described in greater detail with respect to FIG. 4. volume to minimize the degree of interruptibility for non- 

In some embodiments, CDOS systems can supply toother urgent information or to prevent non-employees of the 

CDOS systems various information related to generating the business from perceiving sensitive business information, or 

model of the user condition, and those other CDOS systems using 3-D sound that is output as if from a sound source 

can use that model generation information in addition to or 2 5 located at a particular location in the user's surrounding 

in place of their own model generation information. For environment). Alternately, if the current model of the user 

example, if rules are being used to generate the model of the condition indicates that output to the user is currently 

user condition, one CDOS system can supply some or all of inadvisable (e.g., the user has a high cognitive load, is 

its rules to other CDOS systems. Similarly, default and/or asleep, or sensitive information cannot be safely presented 

specialized sets of model generation information can be 30 in the current environment), the Output Device Selector 

supplied to a CDOS system, either from other CDOS Module instead defers or denies the presentation of the 

systems or by loading that information onto the CDOS information. 

system. A default set of rules may be used by CDOS system In one embodiment, the Output Device Selector Module 

until learning by the system adds or modifies the default selects output devices by first characterizing each of the 

rules to better model the user of the system. Similarly, other 35 output devices relative to selected condition variables, such 

programs (e.g., application programs) can supply rules to the as cognitive load, desired level of privacy, desired scope of 

CDOS system, such as rules specific to that application audience, and intrusive ness on the environment. For 

program. Various specialized sets of rules can also be example, an eyeglass- mounted display may have a high 

supplied. For example, sets of rules may be specialized rating for ability to present sensitive information to only the 

based on occupation (e.g., a nurse, a secretary, a field 40 user » DUt mav h ave a low rating for lack of intrusiveness on 

technician, or a firefighter), gender (e.g., a woman's rules the user (particularly if the user has a high cognitive load 

may understand physiological symptoms related to preg- from another visual activity). Similarly, an olfactory' device 

nancy or other female-specific conditions), age, or any of a which can output various smells may be low on the intru- 

variety of other specialization types. siveness scale, but may be useful for presenting only limited 

After the User Characterization Module has created a 45 types of output (e.g., a soothing aroma when the user has 

model of the user's current condition, the Output Device high blood pressure and a high pulse). Output devices can 

Selector Module and the one or more Format Modules can also be characterized on the basis of the user sense (e.g., 

then use the model to determine when and how to present olfactory or visual) to which the output information will be 

output information to the user. The Output Device Selector presented. 

Module first receives output information to be presented to 50 After the output devices have been characterized on the 

the user (e.g., from an application program), and then selects basis of the condition variables, the Output Device Selector 

an appropriate output device for presenting the information Module then selects the one or more output device which are 

to the user. For example, if the model of the user condition most appropriate for the user's current condition and for the 

indicates that auditory output is currently preferable to other information to be output. In some situations, a characteriza- 

forms of output and the output information can be presented 55 tion of a device relative to a condition variable is dependent 

audibly, then the Output Device Selector Module selects an on the circumstances rather than being inherent in the 

output device that supports audible output. Alternately, the capabilities of a device. For example, a stereo or a television 

value of a desired level of privacy, desired scope of may have a high degree of privacy while only the user is in 

audience, or current cognitive load user condition variable the room, but the characterization for these devices may 

may indicate that audible output is currently preferable. 60 change to a low degree of privacy when others enter the 

While information to be presented to the user will often be room. In some embodiments, such devices are represented 

generated by an entity outside the CDOS system, the CDOS with a characterization that is a range of values, with only a 

system may also generate information to be presented to the single value or a subset of the range selected at a given time 

user (e.g., an indication of low battery power, or of an error based on the current circumstances, 

when adding a rule to the User Characterization Module). In 65 In addition to supplying the output information to be 

addition, in some embodiments external entities such as an presented, an external entity can also supply information 

application program can directly access the model of the that describes the output information, such as the relative 
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importance and urgency (i.e., the degree of deferability, such 
as time sensitivity) of the information, as well as the 
consequences of ignoring the information. In the same 
manner that the output devices can be characterized relative 
to condition variables, they can also be characterized relative 5 
to such factors in the description information. For example, 
an eyeglass-mounted display and an earpiece speaker with 
adjustable volume may both be highly-rated with respect to 
their ability to present important information that has a high 
consequence of being ignored. The earpiece speaker may \q 
have a wide range of ratings for these factors, however, since 
it is also able to present low importance information (e.g., at 
a low audio volume which can be easily ignored by the user 
if the user so chooses). Conversely, the eyeglass-mounted 
display may not be able to unobtrusively present visual 15 
information, and thus may have a small range of ratings for 
this factor. Thus, after the Output Device Selector Module 
receives the information to be output and optionally receives 
a description of the information, the Output Device Selector 
Module then uses the model of the user condition to deter- 2 o 
mine which output device (if any) to use to present the 
information to the user, and a corresponding Format Module 
for that device determines the appropriate format with which 
to present the information to the user. 

In one embodiment, the Output Device Selector Module 25 
includes a characterization of each output device available to 
the CD OS system relative to the user condition variables of 
cognitive load, desired level of privacy, desired scope of 
audience, and desired level of intrusive ness on others, as 
well as to output information description factors of relative 30 
level of importance, deferability, and consequence of ignor- 
ing. The one or more devices which best match the current 
user condition and the current output information will be 
selected, including using user preferences to select between 
different devices. Those skilled in the art will appreciate that 35 
the Output Device Selector Module could determine an 
appropriate output device in a variety of other ways, includ- 
ing receiving a direct specification from the entity supplying 
the output information, selecting the device with the widest 
range of capabilities relative to the type of information to be 40 
output, etc. In addition, a defined API (application program 
interface) can be designed between external entities such as 
application programs and the CDOS system. The defined 
API will allow application programs to supply information 
to User Characterization Modules, extract and add informa- 45 
tion to the model of the user condition, and supply output 
information and description information to Output Device 
Selector Modules. An illustrative example of an Output 
Device Selector Module is described in greater detail with 
respect to FIG. 5. 50 

FIG. 1 illustrates a body-mounted wearable computer 120 
worn by user 110, with the computer suitable for executing 
an embodiment of the CDOS system 100. The user has a 
variety of body-worn input devices including a microphone 
124, a hand-held flat panel display 130 with character 55 
recognition capabilities, and various other user input devices 
122. Similarly, the user has a variety of body- worn output 
devices that include the hand-held flat panel display, an 
earpiece speaker 132, an eyeglass-mounted display 134, and 
a tactile display 136. In addition to the various body-worn 60 
user input devices, the CDOS system can also receive 
information from various body-worn user sensor devices 
126 and environment sensor devices 128. As the user moves 
about in various environments, the CDOS system receives 
various input information, maintains a current model of the 65 
user condition, and presents oulput information to the user 
via appropriate output devices. 
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In the current environment, the user is accessible to a 
computer 150 (e.g., in close proximity to or reachable via a 
long-distance communication device such as a cellular 
phone) which also has a variety of input and output devices. 
In the illustrated embodiment the computer is non-portable, 
although the body-mounted computer of the user can simi- 
larly communicate with a variety of other types of 
computers, including body-mounted computers of other 
users. The devices from which the non-portable computer 
can directly receive information include various user input 
devices 152 and various user sensor devices 156. The 
non-portable computer can output information directly to a 
display 160, a speaker 162, an olfactory device 164, and a 
printer 166. In the illustrated embodiment, the body- 
mounted computer can communicate with the non-portable 
computer via a wireless transmission medium. In this 
manner, the CDOS system can receive information from the 
user input devices 152 and the user sensor devices 156 after 
the information has been transmitted to the non-portable 
computer. Alternately, the body-mounted computer may be 
able to directly communicate with the user input devices 152 
and the user sensor devices 156, as well as with other various 
remote environment sensor devices 158, without the inter- 
vention of the non-portable computer 150. Similarly, the 
body-mounted computer may be able to supply output 
information to the display 160, the speaker 162, the olfac- 
tory device 164, and the printer 166, either directly or via the 
non-portable computer, and directly to the telephone 168. As 
the user moves out of range of the remote input and output 
devices, the CDOS system will be updated to reflect that the 
remote output devices are not currently available to receive 
output. 

Those skilled in the art will appreciate that computer 
systems 120 and 150, as well as their various input and 
output devices, are merely illustrative and are not intended 
to limit the scope of the present invention. The computer 
systems may contain additional components or may lack 
some illustrated components. For example, it is possible that 
the CDOS system could be executed on the non-portable 
computer, with the body-mounted computer replaced by a 
thin client such as a transmitter/receiver for relaying infor- 
mation between the body-mounted input and output devices 
and the nonportable computer. Alternately, no devices or 
computers may be worn by the user. 

In addition, the body-mounted computer may be con- 
nected to one or more networks of other devices through 
wired or wireless communication means (e.g., wireless RF, 
a cellular phone or modem, infrared, physical cable, a 
docking station, etc.), either with or without support from 
other computers such as the computer 150. For example, the 
body-mounted computer of a user could make use of output 
devices in a smart room, such as a television and stereo when 
the user is at home, if the body-mounted computer can 
transmit information to those devices via a wireless medium 
or if a cabled or docking mechanism is available to transmit 
the information. Alternately, kiosks or other information 
devices can be installed at various locations (e.g., in airports 
or at tourist spots) to transmit relevant information to 
body-mounted computers within the range of the informa- 
tion device. 

Those skilled in the art will also appreciate that special- 
ized versions of the body-mounted computer and CDOS 
system can be created for a variety of purposes. For 
example, a wearable defibrillator could be created such that 
the CDOS system monitors the user's physiological condi- 
tion to determine whether output electrical energy needs to 
be supplied to the user, and to automatically supply such 
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output energy when needed. Alternately, a breathing monitor tion about the output device characteristics upon 

system could monitor the user and take appropriate action if initialization, such as from the storage device. Alternately, 

a breathing problem develops (e.g., calling 911 or notifying the Output Device Selector Module could instead receive the 

a nearby medical care provider), or a sleep-sensing system information directly from the output devices as they are 

for a driver of a vehicle could stimulate the driver (e.g., 5 dynamically configured. The source of the output informa- 

audibly or tactilely) when the driver becomes drowsy. A tion can also supply a description of the information to assist 

variety of other physiological conditions can be similarly in selecting where, when and how to present the information 

monitored, and other specialized versions of the system can to the user. After an output device has been selected, the 

similarly be implemented (e.g., an aid for a deaf person that Output Device Selector Module forwards the output infor- 

performs speech recognition on spoken words in order to 10 mation as well as appropriate output information description 

visually display the words, or a mood enhancing device that factors and user condition variables to the Format Module 

triggers various soothing environmental output in response for the output device. In the illustrated embodiment, Format 

to a user condition such as stress or anger). Modules 220 through 228 correspond to the output devices 

FIG. 2 illustrates an embodiment of the body-mounted as shown, 

computer 120 in greater detail. The computer includes a 15 When a Format Module receives the output information, 

memory 270, a CPU 280, and a storage device 290. The it formats the output information for presentation, with the 

CDOS 100 system is executing in memory, as well as one or formatting based in part on the information presentation 

more distinct application programs 260. As the body- capabilities of the output device. For example, the output 

mounted computer receives various input information, the device may be able to output information to more than one 

information is forwarded to the User Characterization Mod- 2 o user ^nse, in more than one way, and with varying degrees 

ule 205 of the CDOS system. These types of information of amplitude or style (e.g., flashing text or enlarged icons), 

include explicit user input to the computer, sensed user The Format Module selects an appropriate method of for- 

information, and sensed environment information. The User matting the information, such as to present the information 

Characterization Module can also receive date and time to only the appropriate audience or with the appropriate 

information from the CPU or from some other source, and 2 5 ^ eve ^ °f intrusiveness, and then sends the information to its 

can retrieve stored information (e.g., user preferences, defi- corresponding output device for display. The Output Device 

nitions of various user-defined groups, or a default model of Selector Module will also inform the User Characterization 

the user condition) from the storage device. It is also Module when output is to take place so that the model of the 

possible for one or more of the application programs to user condition can be updated accordingly, 

optionally supply application-supplied information 265 to 30 Those skilled in the art will appreciate that the Format 

the User Characterization Module. This information can Modules may communicate with their corresponding output 

include any type of user condition information to which the devices in a variety of ways, and that the body-mounted 

application program has access, such as user location or computer in the CDOS system may contain additional 

physiological state. In addition, the application programs components or may lack some illustrated components. For 

can create new user condition variables (e.g., an indication 35 example, there may not be a one-to-one mapping between 

of where the user's pupil is directed for an interactive game Format Modules and output devices, functionality per- 

program), including those to be used only by that application formed by the Output Device Selector Module and Format 

program. Similarly, a utib'ty program could supply user Modules may be incorporated together, and the creation of 

condition information that is useful to a specified subset of the model of the user condition may be performed by a 

application programs (e.g., to various application programs 40 different system than that which uses the information to 

from a single vendor or of a certain type). present output information. There may also be multiple User 

After the User Characterization Module receives one or Characterization or Output Device Selector Modules, such 

more of these types of information, it processes the infor- as one User Characterization Module for each relevant 

mation and creates a model of the user condition 210 which high-level condition variable. Alternately, external entities 

will include multiple user condition variables (with current 45 such as the application programs could add their own User 

values for some or all of the variables). After the model of Characterization, Output Device Selector or Format 

the user condition has been created, the current model will Modules, or could directly access the model of the user 

be made available to the User Characterization Module to condition in order to perform presentation of output infor- 

assist in the characterization of the user, such as with mation. Accordingly, the present invention may be practiced 

changes over time. The model will also be available to the 50 with other computer system configurations. 

Output Device Selector Module 215 to assist with presen- FIG. 3 is an illustrative example of a Model of User 

tation of output information. Moreover, the model of the Condition 210. As is shown, the model reflects the condition 

user condition can additionally be stored in a permanent of user X at time 14:22 hours on the displayed date. The 

manner, such as on the storage device, if non-current ver- illustrative model of the user condition includes a variety of 

sions of the user condition model are useful. Similarly, the 55 user condition variables at different levels of abstraction, 

User Characterization Module, Output Device Selector including low-level information directly from user sensors 

Module, and any Format Modules can be permanently as well as higher- level abstract variables with characterized 

stored before being executed in memory, and any changes values that reflect a user's current physical and mental states, 

made to the modules while they are executing can also be Historical and timesensitive information can also be 

saved. 60 included, as shown by the variable illustrating the last user 

When the Output Device Selector Module receives output input performed by user X. 

information to be presented, such as from one of the Intermediate-level variables included in the model can be 

application programs, it uses the current model of the user calculated from low-level input information such as sensor 

condition as well as information about the available output values. For example, the speed of the user could be calcu- 

devices to determine an appropriate output device on which 65 lated directly by a sensor such as a pedometer, or could be 

to present the information to the user. In some embodiments, calculated indirectly via information over time from a GPS 

the Output Device Selector Module may retrieve informa- sensor. In addition, the Speed variable indicates that addi- 
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tional information can be included in the user model for each ization Module is for user X and it includes a variety of 

variable. In the case of the Speed variable, uncertainty about IF-THEN rules. User condition variables are shown with 

the exact value of the variable is demonstrated. Other angle brackets surrounding them, with some user condition 

calculated condition variables include an indication that the variables (e.g., Speakerphone.Status) not shown in the illus- 

user is located in their office, is near their desk, and that there 5 trative model of user condition 210 in FIG. 3. In addition to 

are no other people physically nearby. These factors can be the IF-THEN rules, WHILE-THEN rules are also shown, as 

determined in a variety of ways, such as via a motion sensor well as an application-specific rule (i.e., the APPX: rule) 

device located on the desk that is tracking the user and the added by an external application. The illustrative User 

absence of other individuals, or by the lack of any sounds Characterization Module also indicates that the results por- 

from any other people via one or more microphones. 1Q tion of the rules (shown after the THEN statements) can set 

Higher-level condition variables can also be calculated, or modify the values of condition variables, such as by 

such as the user's current physical activities, the current user absolute or percentage numerical amounts, and can indicate 

cognitive load, the desired level of privacy, and the desired degrees of belief or uncertainty in values. Groups of people 

scope of audience. Information from the microphone or are shown in square brackets (e.g., Company Executives), 

directly from the cellular phone could indicate that the user 15 and asterisks are wild-card characters that can match any 

is currently talking on their cellular phone, and the speed and information. 

motion sensor data could indicate that the user is walking. As mentioned previously, receiving input related to one 

Since the user remains near his desk even though he is user condition variable can cause multiple changes to propa- 

walking, the system can deduce that the user is pacing about gate through the set of rules. For example, if input is 

his office or is walking on a treadmill (not shown). The User 20 received that indicates that the user condition variable 

Activity variable demonstrates that variables can have mul- Desktop. Motion.Sensor. Human .Movement is true and the 

tiple values, and that information such as a degree of belief User Activity variable value indicates that user is seated, one 

or certainty in the value for a variable can be added and used 0 f the rules shown indicates that the Nearby People variable 

by the system. will be modified (if necessary) to indicate that an "Uniden- 

The Cognitive Load variable indicates a score of 77 out of 2 5 ufted Person" is physically nearby. Modifying the Nearby 

100, thus indicating a relatively high cognitive load due to People variable can then affect the Level Of Privacy or 

the combination of the user walking and talking on the Scope Of Audience user condition variables as shown by 

phone. Since it is unlikely that information presented by the other rules. Those skilled in the art will appreciate that the 

system will be desired to be perceptible by the person on the illustrated User Characterization Module is merely illustra- 

other end of the phone, the desired Scope Of Audience 30 uvc an d is not intended to limit the scope of the present 

variable indicates that only the user is currently appropriate invention. The model may contain additional rules, may lack 

to receive output information. Since the User Characteriza- some illustrated rules, or may be implemented without using 

tion Module was able to identify the other person on the rules at all. In addition, the test and/or results portions of 

phone as Doug Smith, an executive level colleague at user rules can be implemented as invokable Auctions, including 

X's company (e.g., by voice recognition or the use of that 35 those provided by external entities such as application 

person's name), the desired Level Of Privacy variable programs. 

indicates that if information is presented in a manner such FIG. 5 is an illustrative example of Output Device Selec- 

that the other person can receive it (e.g., through an external tor Module 215. As is shown, the module is for user X and 

speaker), general information about the company as well as it maps each available output device to ratings for selected 

executive- level sensitive information can be presented. Note 40 user condition variables and output information description 

that although low-level sensors such as a motion detector factors. As is shown, some output devices which are avail - 

may have indicated that there are no other people physically able at times (e.g., pager 502, cellular telephone 504, and car 

nearby, when it was determined that the user was talking on radio 506) are not currently available. In addition, earpiece 

a phone, additional information was added to the Nearby speaker 132 may not currently be able to receive output 

People variable to indicate that someone is within audio 45 information if it is already in use (e.g., the user is listening 

perception of the user. to music). Alternately, new output information could pre- 

The remaining displayed portions of the user condition empt the current use of the earpiece speaker if necessary, or 

model indicate that user preference information and exter- could instead share the use of the output device (e.g., 

nally supplied information can be included in the user outputting music to one ear and other information to the 

condition model. For example, the Application X-Factor 1 50 other ear if the earpiece speaker is part of headphones), 

variable has been supplied by application X, as well as a As is shown, the various output devices are rated with 

value for the variable. In this case, the value is a normal single values or a range of values for each factor. While 

probability distribution with a mean of 23 and a standard textual values are used, those skilled in the art will appre- 

deviation of 3. In addition, previously supplied user prefer- date that numerical or other types of rating systems could be 

ence information could indicate which output devices and 55 used. In the illustrated embodiment, ranges may illustrate 

which output formats are preferred by the user. Alternately, the device capabilities in different situations, with the ranges 

the system could have automatically learned these prefer- being restricted in any particular situation. For example, the 

ences over time by observing user reactions to various earpiece speaker can accommodate when the user has a very 

outputs, as well as from explicit suggestions and overrides low cognitive load by adjusting the volume to be slightly 

by the user. Those skilled in the art will appreciate that the 60 louder than the ambient environment. Alternately, even if the 

illustrated user condition model is merely illustrative and is user has a high cognitive load, the earpiece speaker can 

not intended to limit the scope of the present invention. The interrupt the user if necessary for urgent information by 

model may contain additional variables or may lack some using very loud volumes or distinctive tones. In addition, the 

illustrated variables, or may be represented without explicit ratings can be adjusted to reflect the specific situation of this 

condition variables at all. 65 user . For example, since the speaker 162 is located on the 

FIG. 4 is an illustrative example of User Characterization user's desk at work and other employees can frequently or 

Module 205. As is shown, the illustrated User Character- always hear the speaker, the value for the desired Level Of 
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Privacy may indicate that only business information be 
presented via the speaker Alternately, the system could 
present information by sending it to the cellular telephone if 
the information is highly sensitive or it is important to 
interrupt the user. However, if others are present around the 
user, frequent use of the cellular telephone can be highly 
intrusive to them (particularly in environments such as a 
lecture or a movie). 

Those skilled in the art will appreciate that the illustrated 
Output Device Selector Module is merely illustrative and is 
not intended to limit the scope of the present invention. The 
module may contain additional user condition variables and 
output information description factors, may lack some illus- 
trated user condition variables and output information 
description factors, or may select output devices on which to 
present output information in an entirely different manner. In 
addition, some embodiments of the Output Device Selector 
Module may include specific logic, such as IF-THEN rules, 
to be used in conjunction with the mapping of output devices 
as shown. 

FIG. 6 is an exemplary flow diagram of an embodiment 
of the User Characterization Routine 600. The User Char- 
acterization Routine retrieves stored information related to 
the user, including a default model of the user condition, 
receives various types of input information related to the 
user or the user's environment, updates the model of the user 
condition to reflect the new information, and periodically 
updates the model if no information has been received 
within a prescribed time. The routine begins at step 605 
where stored information for the user is retrieved, including 
a set of characterization rules to be used by the routine. The 
routine then creates a default model of the user condition, 
such as directly from stored information or by applying the 
characterization rules to default user information that is 
available. The routine then continues to step 610 to set a 
timer, and continues to step 615 to either receive input 
information or to receive a notification that the timer has 
expired. 

The routine continues to step 622 to determine if input 
information was received. If so, the routine continues to step 
625 to determine if the information received was informa- 
tion input to the computer by the user. If so, the routine 
continues to step 630 to determine if the user input indicates 
that the user condition should be modified, such as by setting 
a user preference or explicitly changing the value of a user 
condition variable. If so, the routine continues to step 635 to 
satisfy the user request, and then returns to step 610. If it was 
instead determined in step 630 that the user input was not 
directed to the User Characterization Module, the routine 
continues to step 640 to forward the user input information 
to the appropriate destination (e.g., an application program). 

After step 640, or if it was determined in step 620 that the 
timer had expired or in step 625 that the information 
received was not user input, the routine continues to step 645 
to execute the Characterize User Subroutine to update the 
model of the current user condition. After step 645, the 
routine continues to step 652 to store the updated user 
condition model, and then continues to step 655 to update 
the characterization rules if necessary. The characterization 
rules can be updated in a variety of situations, such as if an 
external entity (e.g., an application) explicitly adds a new 
characterization rule or if the routine monitors the user's 
behavior and reactions in an attempt to learn more appro- 
priate characterization rules. After step 655, the routine 
continues to step 660 to determine if there is more infor- 
mation to receive. If so, the routine returns to step 610, and 
if not, the routine ends at step 695. 
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FIG. 7 is an exemplary flow diagram of an embodiment 
of the Characterize User Subroutine 645. The subroutine is 
executed when information is received related to the user or 
the user's environment, or when a timer has expired indi- 

5 eating that no information has been received for a specified 
period of time. When no information has been received for 
a period of time, the model of the user's current condition 
may need to be updated so that time-sensitive information 
can be updated in the model of the user condition. The 

10 subroutine begins at step 705 where the current model of the 
user condition is retrieved. The subroutine then continues to 
step 710 to retrieve the current date and time. In step 715, the 
subroutine determines whether information was received or 
if the timer has expired. If the timer has expired, the 

15 subroutine continues to step 720 to examiner user condition 
variables that represent time -sensitive information or his- 
torical data and updates them if necessary. The subroutine 
then continues to step 725 to determine if the current date 
and time trigger any characterization rules, and if so, the 

20 changes from these triggered rules are propagated through 
the set of rules. 

If it was instead determined in step 715 that information 
to be processed was received, the subroutine continues to 
step 730 to determine if a new user condition variable has 

25 been defined, such as by an application program, and if so 
continues to step 750. If a new user condition variable has 
not been defined, however, the subroutine continues to step 
735 to determine if a new user characterization rule is being 
added, such as by an application program. If so, the sub- 

30 routine continues to step 740 to add the new characterization 
rule, determine if current values for any user condition 
variables trigger the rule, and if so propagates any changes 
from the triggered rules through the set of rules. If it was 
instead determined in step 735 that a new characterization 

35 rule is not being defined, the subroutine continues to step 
745 to determine if the current input information or the 
current date and time trigger any rules, and if so, changes 
from those triggered rules are propagated throughout the set 
of rules. In addition to information received directly from 

40 the user, sensors, or application programs, this input infor- 
mation can also be a notification from the Output Device 
Selector that indicates output information is currently being 
presented to the user. 

After steps 725, 730, 740, or 745, the subroutine contin- 

45 ues to step 750 to store any changes in user condition 
variables and their values, as well as the new date and time, 
in an updated model of the user condition. The subroutine 
then continues to step 795 and returns. Those skilled in the 
art will appreciate that a variety of types of information 

50 related to the user and the user's environment can be 
received, and that the User Characterization Routine and the 
Characterize User Subroutine can process this information 
in a variety of ways, including other than with sets of 
IF-THEN rules. 

55 FIG. 8 is an exemplary flow diagram of an embodiment 
of the Output Device Selector Routine 800. The Output 
Device Selector Routine receives output information to be 
presented to the user, retrieves current characterized infor- 
mation about the user from the model of the user condition, 

60 determines whether the output information should be pre- 
sented to the user at this time and if so on which output 
device and in what format, and then notifies the User 
Characterization Module when output information is pre- 
sented to the user. The routine begins at step 805 where 

65 output information to be presented to the user is received or 
an indication that a timer has expired occurs. The routine 
continues to step 810 to determine if a timer has expired. 
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When output information cannot be currently presented to 
the user (e.g., no satisfactory output device is available or 
presentation to the user could be dangerous or 
inappropriate), the presentation is deferred and a timer is set 
to indicate when to review presenting the information. Thus, 5 
if it is determined in step 810 that a timer has expired, the 
routine continues to step 815 to retrieve the deferred output 
information for the timer, as well as any description infor- 
mation for the deferred output information. If it is instead 
determined in step 810 that new output information to be 10 
presented has been received, the routine continues to step 
820 where description information for the output informa- 
tion is optionally received. 

After steps 815 or 820, the routine continues to step 825 
to retrieve relevant information from the current model of 15 
the user condition. The routine then continues to step 830 to 
determine whether to currently present the output informa- 
tion to the user. In the illustrated embodiment, this deter- 
mination is made using the user condition variables of 
cognitive load, desired level of privacy, and desired scope of 2 o 
audience. In addition, available description information 
which indicates the importance and the deferability of the 
output information and the consequences of the user ignor- 
ing or not receiving the output information are considered, 
as is any user preference information. Current values for 2 s 
these user condition variables and description factors, as 
well as whether available output devices can support the 
necessary formatting of information (e.g., presenting infor- 
mation to the appropriate scope of audience or at the 
appropriate level of intrusiveness for the user's cognitive 30 
load), are thus used in the determination. Those skilled in the 
art will appreciate that other factors can be used for this 
determination or that the determination could be made in 
other ways. 

" The routine then continues to step" 835 to determine 35 
whether the presentation of the information is to be deferred 
or not. If the presentation is to be deferred, the routine 
continues to step 840 to store the output information as well 
as its description information, and to set a timer for the 
information at which time the presentation of the output 40 
information will be reconsidered. If it is instead determined 
in step 835 that the information presentation is not to be 
deferred, the routine continues to step 845 where an avail- 
able output device is selected. In the illustrated embodiment, 
the output device whose information display capabilities and 45 
ratings best match the user condition variables and descrip- 
tion information factors of interest is chosen. The routine 
then continues to step 850 to execute the Format And Present 
Output Information Subroutine, and then continues to step 
855 to notify the User Characterization Module of the 50 
presentation of the output information. After step 840 or step 
855, the routine continues to step 860 to determine if there 
are currently timers set or there is more output information 
to be received. If so, the routine returns to step 805, and if 
not the routine ends at step 895. 55 

FIG. 9 is an exemplary flow diagram of an embodiment 
of the Format And Present Output Information Subroutine 
850. The subroutine receives output information to be pre- 
sented and its description information, receives relevant user 
condition variables and user preference information, selects 60 
a user sense to which the output information will be pre- 
sented (if the output device supports more than one), selects 
appropriate formatting with which to present the output 
information, and presents the output information to the user. 
The subroutine begins at step 905 where output information 65 
is received, as well as the description information factors, 
user condition variables, and relevant user preference infor- 
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mation. The subroutine continues at step 910 to select a user 
sense that is supported by the selected output device. 

In step 915, the subroutine selects formatting for the 
output information that is appropriate for the user condition 
variables, output information description, and user prefer- 
ences. Those skilled in the art will appreciate the formatting 
of the output information will vary with each user sense 
(e.g., adjusting volume for the audio sense and adjusting 
pressure for the tactile sense), as well as with the specific 
output device. After the formatting for the output informa- 
tion is selected, the subroutine continues to step 920 to 
present the output information to the user with the selected 
formatting. If the Scope Of Audience and Level of Privacy 
user condition variables indicate that the information can be 
presented to other people currently present and the selected 
output device supports such presentation, the information 
will also be presented to these other people. After step 920, 
the subroutine continues to step 995 and returns. 

Those skilled in the art will appreciate that the selection 
of an output device and the formatting of the output infor- 
mation for that device can be performed in a variety of ways. 
For example, other user condition variables and description 
information factors could be used, or the selection could be 
made without resort to such information. For example, in 
one embodiment, the user could explicitly indicate the 
output device and formatting desired for some or all pieces 
of output information (e.g., in response to an notification 
from the system), or another entity (e.g., an application 
program supplying the output information) could explicitly 
designate the output device and/or formatting. 

From the foregoing it will be appreciated that, although 
specific embodiments of the invention have been described 
herein for purposes of illustration, various modifications 
may be made without deviating from the spirit and scope of 
the invention. Accordingly, the- invention is not limited 
except as by the appended claims. 

What is claimed is: 

1. A method for a computer to present information to a 
user on one of a plurality of available output devices, the 
method comprising: 

(a) monitoring the user to collect information about a 
current state of the user; 

(b) modeling a current user condition based on the col- 
lected information by, 

determining a current level of privacy desired by the 
user, the level of privacy indicating a group of people 
allowed to perceive information presented by the 
computer; 

determining a current scope of audience desired by the 
user, the scope of audience indicating how many 
people are intended to perceive information pre- 
sented by the computer; or 

determining a current cognitive load of the user, the 
cognitive load indicating ability of the user to devote 
attention to the computer; 

(c) receiving output information to be presented to the 
user; and 

(d) presenting the output information in a manner con- 
sistent with the modeled current user condition by, 
selecting one of the plurality of output devices such that 

information presentation capabilities of the selected 
output device support the determined current desired 
level of privacy, the determined current desired 
scope of audience, and the determined current cog- 
nitive load; and 
presenting the output information to the user on the 
selected output device, 
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and wherein step (d) is deferred when the output 
information cannot be presented on any of the avail- 
able output devices in a manner consistent with the 
modeled current user condition, 

so that the presentation of information by the computer 
satisfies the modeled current user condition. 

2. The method of claim 1 wherein the modeling of the 
current user condition is additionally based on collected 
information related to a surrounding environment. 

3. The method of claim 1 wherein the monitoring of the 
user is performed by sensors worn by the user. 

4. The method of claim 1 wherein the monitoring of the 
user is performed by sensors remote from the user. 

5. The method of claim 1 wherein the collected informa- 
tion includes information about a current physiological state 
of the user. 

6. The method of claim 1 wherein the collected informa- 
tion includes information about current activities of the user. 

7. The method of claim 1 wherein the computer is a 
wearable computer. 

8. The method of claim 1 wherein an operating system of 
the computer performs the method. 

9. The method of claim 1 Wherein the output information 
is received from a distinct program executing on the com- 
puter. 

10. The method of claim 1 wherein the output information 
is received from another computer. 

U. The method of claim 1 wherein the output information 
is generated by the computer during the monitoring or the 
modeling. 

12. The method of claim 1 wherein the available output 
devices include two display devices with different informa- 
tion presentation capabilities regarding level of privacy, 
scope of audience, and cognitive load, and wherein the 
selected output device is the display device whose informa- 
tion presentation capabilities_best match the modeled current 
user condition. 

13. The method of claim 1 wherein information can be 
presented with the available output devices to the user via at 
least two user senses, and wherein the selecting includes 
determining the user sense via which the output information 
will be presented. 

14. A method for a computer to present information to a 
user on one of a plurality of available output devices, the 
method comprising: 

(a) monitoring the user to collect information about a 
current state of the user; 

(b) modeling a current user condition based on the col- 
lected information by, 

determining a current level of privacy desired by the 
user, the level of privacy indicating a group of people 
allowed to perceive information presented by the 
computer; 

determining a current scope of audience desired by the 
user, the scope of audience indicating how many 
people are intended to perceive information pre- 
sented by the computer; or 

determining a current cognitive load of the user, the 
cognitive load indicating ability of the user to devote 
attention to the computer; 

(c) receiving output information to be presented to the 
user, 

receiving description information for the output informa- 
tion describing importance and deferability of the out- 
put information; and 

(d) presenting the output information in a manner con- 
sistent with the modeled current user condition and in 
a manner consistent with the description information 

by, 
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selecting one of the plurality of output devices such that 
information presentation capabilities of the selected 
output device support the determined current desired 
level of privacy, the determined current desired 
5 scope of audience, and the determined current cog- 

nitive load; and 
presenting the output information to the user on the 
selected output device, 
so that the presentation of information by the computer 
10 satisfies the modeled current user condition. 

15. A computer- implemented method for presenting out- 
put information to a user, the method comprising: 

receiving information about a modeled property of the 
user which affects appropriateness of presenting output 

is information to the user; 

receiving description information indicating importance 
or deferability of the output information, and present- 
ing the output information on the selected output device 
in accordance with the modeled user property; and 

20 when no selectable output device is capable of presenting 
the output information in accordance with the modeled 
user property, deferring the presenting of the output 
information. 

16. The method of claim 15 wherein the received infor- 
25 mation includes information related to a current condition of 

the user, and including modeling the user property based on 
the received information. 

17. The method of claim 16 including monitoring the user 
to collect the received information. 

30 18. The method of claim 15 wherein the received infor- 
mation includes information related to a surrounding 
environment, and including modeling the user property 
based on the received information. 

19. The method of claim 18 including monitoring the 
35 surrounding environment to collect the received informa- 
tion. 

20. The method of claim 15 including before the present- 
ing of the output information, receiving the output informa- 
tion. 

40 21. The method of claim 20 wherein an information 
provider transmits information to various computers within 
a transmission range of the information provider, wherein 
the method is performed by a transportable computer trans- 
ported by the user, wherein the user transports the trans- 

45 portable computer within the transmission range, and 
wherein the received output information is the transmitted 
information. 

22. The method of claim 15 wherein the modeled user 
property is an indication of ability of the user to devote 

50 attention to the presenting of the output information. 

23. The method of claim 22 wherein the ability of the user 
to devote attention is influenced by information being 
received by the user via one user sense, and wherein the 
presenting of the output information is selected to be via a 

55 distinct user sense. 

24. The method of claim 22 including deferring the 
presenting of the output information when the ability of the 
user to devote attention is low, 

25. The method of claim 22 wherein the indication of the 
60 ability of the user to devote attention is an estimate of an 

amount of attention devoted by the user to other current 
activities. 

26. The method of claim 15 wherein the modeled user 
property is a preference of the user for an amount of people 

65 to perceive presented information. 

27. The method of claim 26 wherein the selected output 
device includes a range of information presentation 
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capabilities, wherein others can perceive information pre- 
sented using some of the information presentation 
capabilities, and including selecting those information pre- 
sentation capabilities to be used for the presenting when the 
modeled user property indicates that the others are within 5 
the amount of people to perceive the output information. 

28. The method of claim 26 wherein the selected output 
device includes a range of information presentation 
capabilities, wherein others nearby cannot perceive infor- 
mation presented using some of the information presentation 1Q 
capabilities, and including selecting those information pre- 
sentation capabilities to be used for the presenting when the 
modeled user property indicates that the others exceed the 
amount of people to perceive the output information. 

29. The method of claim 15 wherein the modeled user 
property is a preference of the user for how to receive 15 
sensitive information. 

30. The method of claim 29 wherein the selected output 
device includes a range of information presentation 
capabilities, wherein others can perceive information pre- 
sented using some of the information presentation 20 
capabilities, and including selecting those information pre- 
sentation capabilities to be used for the presenting when the 
modeled user property indicates that sensitivity of the output 
information allows the others to perceive the output infor- 
mation, 25 

31. The method of claim 29 wherein the selected output 
device includes a range of information presentation 
capabilities, wherein others nearby cannot perceive infor- 
mation presented using some of the information presentation 
capabilities, and including selecting those information pre- 
sentation capabilities to be used for the presenting when the 
output information is sufficiently sensitive that the modeled 
user property indicates that the others are not allowed to 
perceive the output information. 

32. A computer-implemented method for presenting out- 35 
put information to a user, the method comprising: 

receiving information about a modeled property of the 
user which affects appropriateness of presenting output 
information to the user, the modeled user property 
being an indication of a degree of interruptibility of 
current activities of the user; 

selecting an output device capable of presenting the 
output information in accordance with the modeled 
user property; and 45 

presenting the output information on the selected output 
device in accordance with the modeled user property. 

33. The method of claim 32 wherein the degree of 
interruptibility of the current activities is influenced by 
information being received by the user via one user sense in 50 
conjunction with the current activities, and wherein the 
presenting of the output information is selected to be via a 
distinct user sense. 

34. A computer- implemented method for presenting out- 
put information to a user, the method comprising: 55 

receiving information about a modeled property of the 
user which affects appropriateness of presenting output 
information to the user, the modeled user property 
being a preference of the user for receiving information 
during current activities of the user; 60 

selecting an output device capable of presenting the 
output information in accordance with the modeled 
user property; and 

presenting the output information on the selected output 
device in accordance with the modeled user property. 65 

35. The method of claim 34 including deferring the 
presenting of the output information when the preference of 



the user is to not receive the output information during the 
current activities. 

36. The method of claim 34 including presenting the 
output information non-intrusively when the preference of 
the user is to not receive output information during the 
current activities. 

37. A computer-implemented method for presenting out- 
put information to a user, the method comprising: 

receiving information about a modeled property of the 
user which affects appropriateness of presenting output 
information to the user; 

selecting an output device capable of presenting the 
output information in accordance with the modeled 
user property, the selected output device including a 
range of information presentation capabilities; 

formatting the output information to select information 
presentation capabilities of the selected output device 
to be used such that the selected information presen- 
tation capabilities are consistent with the modeled user 
property; and 

after the formatting, presenting the output information on 
the selected output device in accordance with the 
modeled user property. 

38. The method of claim 15 wherein a plurality of output 
devices are available to present information via distinct 
senses of the user, and wherein the selecting of the output 
device includes determining a user sense which is capable of 
presenting the output information in accordance with the 
modeled user property. 

39. The method of claim 15 wherein the selected output 
device has only a single physical mechanism for presenting 
the output information to the user. 

40. The method of claim 15 wherein the computer per- 
forming the method is transportable by the user, wherein 
fixed output devices become available to the computer when 
the user transports the computer near the fixed output 
devices, and wherein the selected output device is a fixed 
output device. 

41. The method of claim 15 wherein a user computer 
performing the method is transportable by the user, and 
wherein the user computer can communicate with other 
devices within a transmission range of the user computer. 

42. The method of claim 41 wherein the user computer 
communicates with another computer, and wherein the 
selected output device is an output device of the another 
computer. 

43. The method of claim 41 wherein the received infor- 
mation is from one of the other devices. 

44. The method of claim 41 wherein the output informa- 
tion to be presented is received from one of the other 
devices. 

45. The method of claim 41 including after the presenting 
of the output information, revising the modeled user prop- 
erty based on the presenting. 

46. The method of claim 15 wherein the modeled user 
property indicates capabilities of the user for receiving 
presented output information. 

47. The method of claim 46 wherein the capabilities 
indicate that a physical disability of the user prevents the 
user from perceiving some types of presentations of 
information, and wherein the presenting of the output infor- 
mation is in a manner perceivable by the user. 

48. The method of claim 15 including modeling properties 
of the user for use when presenting output information to the 
user by: 

receiving first information about a current state of the 
user; and 
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for at least one of a plurality of properties of the user 
which affects appropriateness of presenting output 
information to the user, modeling the property by 
determining whether the received first information 

relates to the property; and 
when the received first information relates to the 
property, determining a current value for the prop- 
erty based at least in part on the received first 
information. 

49. The method of claim 48 including: 

receiving the output information, and wherein the pre- 
senting of the output information is to the user and is in 
accordance with the modeled user properties. 

50. The method of claim 48 including when a program has 
output information to present to the user, supplying the 
determined current values of the modeled user properties to 
the program so that the output information can be presented 
to the user by the program in accordance with the modeled 
user properties. 

51. The method of claim 48 including when determined 
current values of the modeled user properties change, auto- 
matically supplying the changed current values to the pro- 
gram so that the output information can be presented in 
accordance with the changed current values of the modeled 
user properties. 

52. The method of claim 48 wherein the determining of 
the current value for the property is based on a plurality of 
modeling rules. 

53. The method of claim 52 wherein when the user is in 
a specified class of users, using modeling rules specialized 
for the specified class. 

54. The method of claim 52 wherein when the user is not 
in a pre-determined class of users, using default modeling 
rules. 

55. The method of claim 52 including updating the 
modeling rules based on the received first information so as 
to better model the user. 

56. The method of claim 52 wherein the computer can 
communicate with another computer, and including receiv- 
ing from the another computer new modeling rules to be 
used for the determining of the current value. 

57. The method of claim 48 wherein the computer can 
communicate with another computer, the another computer 
able to obtain information about the user via input devices 
of the another computer, and wherein the received first 
information is obtained information about the user from the 
another computer. 

58. The method of claim 48 wherein the computer can 
communicate with another computer, and including receiv- 
ing from the another computer information about properties 
of the user to be added to the modeled user properties, the 
added properties distinct from the modeled user properties. 

59. The method of claim 48 wherein the computer can 
communicate with another computer, and including receiv- 
ing from the another computer a value for one of the 
modeled user properties to be stored as the determined 
current value for the one property. 

60. The method of claim 48 wherein the plurality of 
properties of the user are modeled based on received infor- 
mation to create a model of a user condition. 

61. The method of claim 48 including monitoring the user 
to obtain the received first information. 

62. The method of claim 48 wherein multiple pieces of 
information are received which relate to a property of the 
user, wherein the multiple pieces of information are incon- 
sistent as to the current value for the property, and wherein 
the determining of the current value involves mediating the 
inconsistencies. 
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63. The method of claim 48 wherein a rating indicating 
quality of the received first information is received, and 
wherein the quality rating is reflected in the determined 
current values for the properties which relate to the received 

5 first information. 

64. The method of claim 48 including: 
determining that a current value for a user property is 

needed for presenting output information to the user; 
and 

10 obtaining information related to the user property to allow 
determination of the current value. 

65. The method of claim 32 including deferring the 
presenting of the output information when the degree of 
interruptibility of the current activities is low. 

66. The method of claim 32 wherein the degree of 
interruptibility of the current activities is low when the 
current activities involve a risk of harm to the user. 

67. A computer- implemented method for presenting out- 
put information to a user, the method comprising: 

receiving information about a modeled property of the 
20 user which affects appropriateness of presenting output 
information to the user, the modeled user property 
being an indication of appropriateness of presenting the 
output information in a manner perceivable by others; 
selecting an output device capable of presenting the 
25 output information in accordance with the modeled 
user property; and 
presenting the output information on the selected output 
device in accordance with the modeled user property. 
3Q 68. The method of claim 67 wherein the selected output 
device includes a range of information presentation 
capabilities, wherein others cannot perceive information 
presented using some of the information presentation 
capabilities, and including selecting those information pre- 
~ 5 sentation capabilities to be used for- the presenting when the 
modeled user property indicates that presenting the output 
information in a manner perceivable by the others is not 
appropriate. 

69. The method of claim 67 including deferring the 
40 presenting of the output information when the modeled user 
property indicates that presenting the output information in 
a manner perceivable by others is not appropriate and 
available output devices cannot present the output informa- 
tion in a manner not perceivable by the others. 
45 70. A method for a wearable computer to present output 
information to a user wearing the wearable computer, the 
wearable computer having a plurality of output devices from 
which the user can receive information, the method com- 
prising: 

50 monitoring the user to collect information; 

characterizing the user based on the collected information 
so as to identify an ability of the user to currently 
receive the output information and a desire of the user 
of how to currently receive the output information; 
55 receiving description information indicating importance 
or deferability of the output information; 
selecting one of the plurality of output devices such that 
information presentation capabilities of the selected 
output device support the identified ability and desire 
60 and such that the selecting is performed in accordance 
with the description information; and 
presenting the output information to the user on the 
selected output device consistently with the identified 
ability and desire. 
65 71. The method of claim 70 including receiving the output 
information from an application program executing on the 
wearable computer. 
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72. The method of claim 70 wherein the wearable com- 
puter has multiple display devices worn by the user, the 
multiple display devices having distinct information presen- 
tation capabilities, and wherein the selecting of one of the 
plurality of output devices selects one of the multiple display 
devices. 

73. A computer-readable medium containing instructions 
for presenting output information to a user, by performing a 
method comprising: 

receiving information about at least one modeled charac- 
teristic of the user which affects appropriateness of 
presenting output information to the user; 

receiving the output information; 

receiving description information indicating importance 
and/or deferability of the output information, 

when a selectable output device is capable of presenting 
the output information in accordance with the modeled 
user characteristic and the description information, 
selecting the output device and presenting the output 
information on the selected output device in accordance 
with the modeled user characteristic; and 

when no selectable output device is capable of presenting 
the output information in accordance with the modeled 
user characteristic deferring the presenting of the out- 
put information. 

74. The computer-readable medium of claim 73 wherein 
the at least one modeled characteristic is based on collected 
information related to the user. 

75. The computer-readable medium of claim 74 wherein 
the computer system is further controlled by monitoring the 
user to obtain the collected information. 

76. A computer- readable medium whose contents cause a 
computer to present output information to a user by: 

receiving information about a modeled property of the 
user which affects appropriateness of presenting output 
information to the user; 

selecting an output device capable of presenting the 
output information in accordance with the modeled 
user property, the selected output device including a 
range of information presentation capabilities; 

formatting the output information, the formatting to select 
information presentation capabilities of the selected 
output device to be used such that the selected infor- 
mation presentation capabilities are consistent with the 
modeled user property; and 

after the formatting, presenting the output information on 
the selected output device in accordance with the 
modeled user property. 

77. The computer-readable medium of claim 73 wherein 
the instructions cause the presenting of the output informa- 
tion to the user when executed by a computing device. 

78. The computer-readable medium of claim 77 wherein 
the computer-readable medium is a memory of the comput- 
ing device. 



56,232 Bl 

28 

79. The computer-readable medium of claim 73 wherein 
the computer-readable medium is a data transmission 
medium transmitting a generated data signal containing the 
instructions. 

s 80. A computer system for presenting output to a user, 
comprising: 

an output device selector module that receives informa- 
tion about a modeled property of the user which affects 
10 appropriateness of presenting output to the user, that 
receives description information indicating importance 
or deferability of the output, that selects an output 
device capable of presenting the output in accordance 
with the modeled property and in accordance with the 
15 description information, and that presents the output on 
the selected output device in accordance with the 
modeled property. 
81. The computer system of claim 80 further comprising 
the selected output device. 
20 82. The computer system of claim 80 further comprising 
a model of a current condition of the user, the model 
including a plurality of user properties including the mod- 
eled property. 

83. The computer system of claim 80 wherein the com- 
25 puter system further comprises a user characterization mod- 
ule that generates the modeled property based on collected 
information related to the user or to a surrounding environ- 
ment. 

84. The computer system of claim 30 wherein the user 
30 characterization module further monitors the user or the 

surrounding environment to obtain the collected informa- 
tion. 

85. The computer system of claim 80 wherein the selected 
output device includes a range of information presentation 

35 capabilities, and further including a format module- that 
formats the output before the presenting, the formatting to 
select information presentation capabilities of the selected 
output device to be used such that the selected information 
presentation capabilities are consistent with the modeled 

40 property. 

86. The computer system of claim 80 wherein the 
received information is current physiological information 
about the user indicating a health condition, and wherein the 
presenting of output is to another person to alert the another 

45 person of a health problem detected from the current physi- 
ological information. 

87. The computer system of claim 80 wherein the 
received information is current physiological information 
about the user indicating a health condition, and wherein the 

50 presenting of output is to administer medical care for the 
health condition. 

88. The computer system of claim 80 wherein the output 
device selector module is executing in memory of the 
computer system. 

+ + * * * 
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